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1. Introduction 



C^ , Classical Brill-Noether theory studies the space of line bundles of a given degree 

with a given number of global sections on a general smooth projective curve of given 
genus. The basic questions on non-emptiness, dimension, and smoothness were 
finally settled by work of Kempf, Kleiman-Laksov, Griffiths-Harris, and Gieseker 
concluding in the early 1980's. The natural generalization of these questions to 
QQ ' higher-rank vector bundles remains very much open, even in the case of rank 2, 

^^ , despite much progress due to many people (see [4] for a survey). Complications 

^^ ' (in the form of components of larger than the expected dimensions) are known to 

^^ \ occur due to instability of the underlying bundle, and due to symmetries introduced 

10 ' by special determinants. The former is easily avoided by restricting to stable or 

^P \ semi-stable loci, but the latter seems to be a fundamental phenomenon. Our aim 

is to study this issue systematically, and our results are substantial generalizations 
of the original work of Bertram and Feinberg [1] and Mukai [8] which pioneered the 
subject by studying Brill-Noether loci for fixed canonical determinant. 

If C is a smooth projective curve of genus g, and we are given r, d. A;, the space 
}_] ' t/,^(r, d, fc) parametrizing pairs of a vector bundle of rank r and degree d, with a 

Cu I A:-dimensional space of global sections, has an expected dimension 

p(r, d, k, g) =r^{g-l) + l-k{k-d + r{g - 1)), 

directly generalizing the classical case r — 1. However, for r > 1 the space turns out 
to be quite difficult to describe. Unlike the case r = 1, even for a general curve C it 
can be empty when p{r, d, fc, g) > (with suitable stability restrictions), non-empty 
when p{r, d, k, g) < 0, and can have multiple components of distinct dimensions. 

One case which appears to be better behaved is the case of rank 2 with canonical 
determinant. This was studied independently by Bertram and Feinberg [1] and 
Mukai [8], who both showed that in fact every component of the space Q{2, w, k) of 
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pairs with canonical determinant has dimension at least 

p„(fc,5):=3.g-3- T + j = pi2,2g - 2,k,g) - g + T 

They also conjectured that this locus had good behavior analogous to the classical 
rank-1 setting. 

Our main results are the following: 

Theorem 1.1. Let C be a smooth projective curve of genus g, and ^ a line bundle 
of degree d on C. Let S > be the smallest degree of an effective divisor A such 
that h^{C,J^{—A)) > 1. Then every irreducible component of the stack Q{2,J^,k) 
of pairs with determinant J^ has dimension at least 



Psfik^g) --^ p{2,d,k,g)-g+ i 



k^6 



Moreover, every pair (S',V) corresponding to a point of Q{2,J^,k) satisfies the 
condition 

dim(y n H°{C, f?'(-A))) >k^S. 

See §2 for more details on definitions and notation. Note that this estimate only 
differs from the usual one if fc > ^ + 2, and the Bertram-Feinberg-Mukai result is 
simply the case of Theorem 1.1 where J^ = ui (and therefore 6 = 0). More generally, 
we have: 

Corollary 1.2. LetC be a smooth projective curve of genus g, and ^ a line bundle 
of degree d on C , and suppose that h^(C,^) > 1. Then every irreducible component 
of G{2,^,k) has dimension at least 



P]^ik, g) = p(2, d,k,g)- g+{\. 



The case that (5 > is also interesting, as it yields examples where the dimension 
is larger than expected even in degree strictly greater than 2g — 2. This is perhaps 
not surprising if one thinks in terms of constructions via extensions, but it under- 
lines the point that the sense in which Brill-Noether theory in rank 2 will depend 
on "rank-1 phenomena" goes beyond cases like canonical determinant, when the 
determinant is special in the Brill-Noether sense, to include at least some cases 
where the determinant is not special, but can be expressed as the tensor product 
of two special line bundles. 

In the case 5 = 0, we are further able to show that we have the beginning of a 
possible trend: 

Theorem 1.3. Let C be a smooth projective curve of genus g, and ^ a line bundle 
of degree d on C. Suppose that h^(C,^) > 2. Then every irreducible component 
of G{2,^,k) has dimension at least 

p%{k,g):=p{2,d,k,g)-g + 2( 

In particular, we find a range of candidates for components of Gc{2, -S?, k) having 
dimension strictly greater than p(2, d, k, g). 
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Corollary 1.4. Suppose we have C,^,k as in Theorems 1.1 and 1.3, and further 
we either have 6 as in Theorem 1.1 such that ( "o ) > .9? or we have h^{C,^) > 1, 
with 2(2) > g, 

Then ifQ{2, Jif, k) is non-empty, it has dimension strictly greater than p(2, d, k,g). 

Even in cases where these modified expected dimensions turn out to be sharp, 
one is left to determine when they are non-empty: certainly there are cases where 
the expected dimension is positive but the corresponding locus is empty. 

Our techniques generalize the arguments of Bertram, Feinberg and Mukai relat- 
ing to symplcctic forms on vector bundles. Theorem 1.1 is a relatively straightfor- 
ward generalization, but Theorem 1.3 requires a detailed analysis of the behavior 
of "doubly symplectic Grassmannians," which parametrize subbundles which are 
simultaneously isotropic for a pair of symplectic forms. These Grassmannians ap- 
pear to be new, and the analysis of their singularities forms the technical core of 
the present paper. 

One aspect of our techniques is that they transparently generalize to the case 
where the curve C is allowed to vary in families. We do not state our results in 
this generality because we expect the main applications of such generalization will 
arise when combined with the appropriate degeneration techniques. 

Acknowledgements. I would like to thank Izzet Coskun, Montserrat Teixidor i 
Bigas, and Peter Newstead for helpful conversations. 

2. Preliminaries 

We work throughout over a base field F, of arbitrary characteristic. For conve- 
nience, we assume throughout that F is algebraically closed. However, Theorems 
1.1 and 1.3 hold for arbitrary fields, and indeed the general case reduces immedi- 
ately to the algebraically closed case. 

Given a vector bundle S on & scheme X, recall that an alternating form on <S 
is a morphism {,) : S ® S" ^f ffx satisfying {s,s) =0 for any section s of (f on an 
open subset of X. This implies that (, ) is skew-symmetric and indeed the two are 
equivalent away from characteristic 2. An alternating form (, ) is symplectic if it is 
nondegenerate on all fibers of S. 

We argue extensively in terms of codimension. If Z C A is closed, but Z and A 
are not irreducible, recall that the standard codimension convention is that 

codimx Z ~ min ( max (codimx' Z')), 

Z'QZ X'(1X 

where Z' and A' range over the irreducible components of Z and A, respectively. 
Thus, we see that the condition that Z has codimension at most d in A is weaker 
than the condition that every component of Z has codimension at most d in A, 
but this latter is equivalent to saying that every component of Z has codimension 
at most d in every component of A. This distinction is important in applications, 
and in our results (see for instance Corollaries 3.7 and 4.3), the latter sort of bound 
will arise naturally. In addition, for lack of a suitable reference we have included in 
Appendix A a brief treatment of codimension for algebraic stacks. 

We work systematically with algebraic stacks to avoid difficulties and pathologies 
arising from the use of coarse moduli spaces. However, our arguments adapt to 
the corresponding coarse moduli spaces as long as one is willing to restrict to the 
stable locus (and moreover, the dimension statement for the stacks imply the same 
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statements for the coarse moduli spaces). We generally use calligraphic letters for 
stacks and roman letters for schemes. 

Our notation for the various moduli spaces will be as follows. 

Definition 2.1. If X is a scheme, and S' a vector bundle of rank r on X, then for 
any k < r we denote by G{k, S) the relative Grassmannian scheme over X, with 
T-valued points of G{k, S') corresponding to rank-fc subbundles of the pullback of 
<§ from X to T. Similarly, if X is an algebraic stack, then Q{k,S') is the relative 
Grassmannian of rank-fc subbundles of S". 

The usual argument goes through in the case of algebraic stacks to show that 
G{k, S') is smooth of relative dimension k{r — k) over X. 

Our convention throughout is that a curve is geometrically integral, and C always 
denote a smooth, projective curve of genus g over F. The canonical line bundle on 
C is denoted by uj. 

Definition 2.2. Let .^^ be a line bundle on C. For any r > 2, we have the moduli 
stack A4 {r, ^) of vector bundles S' of rank r on C together with an isomorphism 
dct S'^^. 

This is an Artin stack, smooth over F of dimension (r^ — l){g — 1). On the 
open substack of stable bundles, it is a Deligne-Mumford stack (assuming that 
chari^ ^ r); note that the isomorphism deti^ —>■ S£ reduces the dimension of all 
automorphism groups by 1. 

Definition 2.3. Given C, S£ as above, and fc > 0, we denote by Q{r,J^,k) the 
stack whose T-valued points consist of triples {S", ip, Y), where: 
(i) (? is a vector bundle of rank r on Ct := T Xp C; 
(ii) ip : det (^ — >■ .jSf is an isomorphism; 

(iii) Y C pi^f? is locally free of rank k on T, and the inclusion into pi^^o" remains 
injective after arbitrary base change, in the sense that for all T' — s- T, we 
have that the induced map 1^|t' -^ Pi*(<^|cj,/) remains injective, where 
p'l : Ct' -^ T' is the projection morphism. 

As in the classical case, G{r, ^, k) may be constructed as a closed substack of a 
relative Grassmannian stack over M (r, .jSf ) , by twisting the universal bundle with 
(the pullback of) a sufficiently ample divisor on C prior to pushing forward. The 
only difference is that because M.{r,^) is not quasicompact, one has to carry out 
the construction locally on an open cover by quasicompact substacks. We thus find 
that the map ^(r, Jf, fc) — ;• M.{r,^) is representable by schemes, and is indeed 
projective, at least locally on M.{r,^). The construction also shows that every 
component of Qir,^ , fc) has dimension at least p ~ g. 

3. Symplectic and Alternating Grassmannians 

Let AT be a scheme, and S a vector bundle on X of rank r. Suppose we are given 
a symplectic form (, ) on iS . Then we make the following definitions: 

Definition 3.1. Given fc < r, we have the symplectic Grassmannian SG{k, £",{,)) 
defined as the closed subscheme of G(fc, (?) consisting of subbundles isotropic for 

(,)■ 

Now suppose that (, ) is an alternating but not necessarily nondegenerate form 
on (?. We can similarly define: 
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Definition 3.2. Given fc < r, we have the alternating Grassmannian AG{k, S', (, }) 
defined as the closed subscheme of G{k, S) consisting of subbundles isotropic for 

(,)■ 

We make the following definition: 

Definition 3.3. We say that (, ) has uniform degeneracy of rank p if the kernel 
of the induced map (? — >■ ^* is given by a subbundle J^ of rank p, and furthermore 
J{f is equal to the kernel even after base change. 

Unless stated otherwise, we assume throughout this section that (, ) has uniform 
degeneracy of rank p. Note that (, } induces a symplcctic form on S / J(f , so we 
necessarily have that r ~ p =: 25 is even. It is then standard that: 

Proposition 3.4. AG(fc, S ^ (, )) is non-empty if and only if k < r — S, and in this 
case is universally topologically flat over X , with fibers which are pure of dimension 

Furthermore, if a subspace V C S'\x corresponds to a point of AG{k,S', (,)) lying 
over some x € X , then 

dimT^n JTU > k - S. 
In addition, AG{k, S , (, )) — SG{k, S , (, )) is smooth in the case p = 0. 

Note that \i p — Q, we necessarily have fc < (5 = | in order for SG{k,S', (,}) 
to be non-empty. Here, by "universally topologically flat" we mean that every 
irreducible component of AG{k, <?, (, )) dominates an irreducible component of X, 
and the same holds after arbitrary base change. Note that in particular any flat 
morphism is universally topologically flat. 

Proof. We define a stratification of AG{k, S", {,)) by locally closed subschemes Ti as 
follows. If ^ is the universal subbundle on AG{k, S, (, )), then Ti is defined as the 
locus on which the rank of the intersection .^ n J^ is equal to i. We have < i < p 
by definition, so if we prove that each Tt is smooth over X, the desired smoothness 
statement for SG{k,S', (,)) will also follow. In fact, we will prove that each Ti is 
smooth over X of relative dimension 

i{p-i) + {k-i){r -k) - f ^ 

non-empty if and only if 

k — 5 < i <p, 
with irreducible fibers, and such that each Ti is in the closure of Ti_i as long as 
Ti^i is non-empty. 

Let Ti be the relative flag variety over Ti parametrizing ,^ together with a com- 
plete flag of subbundles of ,^ /{,!^ fl J^). Then Ti is smooth over Ti of relative 
dimension ( 2 ') . On the other hand, we can construct Ti as a tower of smooth 
schemes over X as follows: we let T^ be the relative Grassmannian of rank-i sub- 
bundles ,^° of J^ . We then define each T- ioi j = 1, . . . ,k — i over T/" to be the 
open subscheme of the relative Grassmannian parametrizing rank-(i + j) isotropic 
subbundles J^^ of (? which contain ^^~^ and such that ^^ D J^ = ^^ . It is then 
clear that T,^^^ ~ Ti. We note that since we are working with an alternating form 
the condition that ^^ is isotropic is equivalent to the conditions that it contain 
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^'^^^ and be contained in (,^-'^^)^. Moreover, since the form is degenerate pre- 
cisely on JT, and ^^^^ <r\ X ^ ,^°, we see that {.3^^^^)^ has rank r - j + 1. We 
thus see that if Ti is non-empty, it is smooth over X of relative dimension 

i{p -i) + ^(r - i - 2j + 1) = i{p - i) + {k - i){r - k). 

Moreover, Ti is non-empty if and only each ^^ may be chosen to have no larger than 
the desired intersection with J(f , which holds if and only if p-|- {i-\-j) < {r — j-\-l)+i 
for all j, or cquivalently 2j >p — r + 2k — 1 = —2S + 2k — l, which is the same as 
i>k-S. 

It remains to check that in every fiber, every point of Ti is in the closure of Ti-i 
for z — 1 > k — S. Accordingly, suppose X is a point, and J^o is an isotropic subspace 
of S", with .^0 n ^ having dimension i. Choose a basis ei, . . . , e^ for ,^q such that 
ei, . . . , Gj span ^q n J(^ . Let e be a vector contained in ^^^ \ span(^, ^q); note 
that dim J^^j- = r — k + i = 2S + p — k + i>p + k — i by hypothesis, so such an e 
exists. Then for t ^ 0, the vector space ^t = span(ei, . . . , e^-i, e^ +te, e^+i, . . . , e^) 
lies in Ti_i, and ^t goes to J^o as t goes to 0, so we conclude that ^o is in the 
closure of Ti_i. 

We thus have that AG{k, <^, (, )) is universally topologically flat, with pure fiber 
dimension equal to the relative dimension of Tniax{o,fc-5}j which is 

j k{r - k) - kS + {'^+^) : k>6 
\k{r^k)~{l): k<d, 

which yields the desired formula. D 

We next recall the following well-known lemma in dimension theory. 

Lemma 3.5. Suppose f : Y' ^>- Y is a morphism of X- schemes, locally of finite 
type. Let Z ^Y be an irreducible closed subscheme of codimension d containing a 
smooth point of Y over X. Suppose that either X is regular, or X is universally 
catenary and Z is universally topologically flat over X. Then every irreducible 
component of f~^{Z) has codimension at most d. 

Recall that X being universally catenary is a mild chain-theoretic condition 
which is satisfied if, for instance, X is of finite type over a Cohen-Macaulay scheme 
(Corollary 6.3.7 of [2]). 

Proof. Since codimension is local, we may suppose that Y is smooth over X. If X is 
regular, then so is F, and the result is a theorem of Hochster (Theorem 7.1 of [6]), 
based on a theorem of Serre. Suppose instead that X is universally catenary, and 
Z is universally topologically flat over X. We have that f~^{Z) is the intersection 
of the graph Tf C Y' XxY with Y' Xx Z. Moreover, Tf is a local complete 
intersection in F' x^ ^ because it is the pullback under / x id of the diagonal 
^ '^Y XxY , which is a local complete intersection subscheme by smoothness of Y 
over X. Under our hypotheses, we have Y' Xx Y locally Noetherian and catenary, 
so intersection with a local complete intersection can only decrease codimension 
of components, and it is thus enough to see that every component Z' of F' xx Z 
has codimension at most d in every component of y Xx Y containing it. But we 
note that Y' Xx -^ is topologically flat over Y' by hypothesis, so Z' is supported 
in a generic fiber over Y', and we can compute codimension in that fiber. Since 
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codimension in a fiber is preserved under base change, and botli Y and Z have 
constant dimension in fibers by hypothesis, we obtain the desired bound. D 

Remark 3.6. One sees that some additional hypotlieses on X or Z along the lines 
of those of the lemma are in fact necessary, as otherwise we can set Y ^ X, and let 
both Y' and Z be closed subschemes, and we obtain subadditivity of intersection 
codimension as a special case. That this is false without some regularity hypotheses 
is well known. In our application, in fact both sets of hypotheses of the lemma are 
satisfied. 

Wc finally conclude the desired statement on the dimension of spaces of subbun- 
dles when degeneracy conditions are imposed with respect to a symplectic form. 

Corollary 3.7. Suppose S' is a vector bundle of rank r on an algebraic stack X of 
finite type over a Cohen- Macaulay algebraic stack. Given {,) a symplectic form on 
S , let -^ and ^ be subbundles of S of ranks s and t, with J# isotropic with respect 
to (, ), and J? having degeneracy of uniform rank s — 2d. Then for any k > 0, every 
component of the closed substack Q{k,J^ C\'i^) ofQ{k,S') parametrizing (necessarily 
isotropic) subbundles of S contained in both ^ and ^ has codimension at most 

fk — (5^ 
fc(2r -^s-t)-y 2 

in every component of Q{k,S'). Moreover, every such subbundle intersects the de- 
generacy subbundle of ^ with rank at least k ^ S. 

Note that Q{k, ^ n ^) is empty unless k<t, s<r,2t<r. One can check that 
these inequalities imply that the asserted codimension bound is in fact positive. 

Proof. We first prove the desired bound in the case that A" = X is a (universally 
catenary) scheme. Now, since every subbundle of $# is necessarily isotropic, we can 
represent G{k,^ D $^) as the locus of isotropic subbundles of ^ of rank k which 
are contained in ^. We thus start with AG{k, jF, (, )), which we claim has every 
component of codimension equal to k{r — s) + (2) ~ ( 2 ) ^^ G{k,S'). Indeed, 
by Proposition 3.4 we know every component of AG(fc,^, (, )) is supported over 
a generic point of X, so it is enough to carry out the computation in the generic 
fiber, and the formula for the dimension of fibers then proves our claim. 

Next, we note that AG{k,^, (,)) has a natural map to SG{k,S', (,)) induced 
by ^ M> (?, and the puUback of ^ to AG{k,J^, (,)) also induces a natural map 
to SG{t,(S', (,}). The locus G{k,^ n ^) of interest is precisely the preimage in 
AG(fc, ^, (, )) of the incidence correspondence / C SG{k, S, {, }) Xx SG{t, S , (, )). 
The second projection makes / into a G(fc, i)-bundle over SG{t, S", (, )), so is smooth 
of relative dimension k{t — k). On the other hand, SG{t, (§",{,)) is itself smooth of 
relative dimension t{r — i) — f,) over X , so we conclude that / is smooth of relative 
dimension k{t — fc) + t{r — t) — (*) over X. Since SG{k, f?, (, )) is smooth of relative 
dimension k{r — fc) — (2), we have that / has pure codimension k{r — i) — (2) in 
SG{k, S, (, )) Xx SG{t, <g, (, )). Thus, by Lemma 3.5 (using that G(fc, (?) is catenary 
to obtain additivity of codimension) we obtain the desired bound. 

We now prove the general statement. Let y be the Cohen-Macaulay algebraic 
stack over which X has finite type, and let X — ^ <¥ be a smooth cover of X by 
a scheme X which factors through a smooth cover of y. Then X is necessarily 
universally catenary. Let Sx^^x^'^x be the pullbacks of (?, ^, ^ to X. Then (, ) 
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pulls back to a symplectic form (, )x on Sx, and we have the identities G{k, ^x H 
"Sx) = e(fc,^n^) XatX and G{k,Sx) =Q{k,S) Xx X. Let Z be an irreducible 
component Q{k,^ fl ^); by definition, we want to prove that Z ^ Z Xx X has 
codimension at most fc(2r — s — t) — y 2 ) ^'^ G{k^ <Sx)- But by Lemma A. 3, every 
irreducible component of Z = Z x xX is an irreducible component of G{k, ,'^x^'^x), 
so we conclude the desired codimension bound from the case of schemes. 

Finally, the assertion that every point of Q(k-, J^ fl ^) corresponds to a bundle 
intersecting the degeneracy subbundle of ^ with rank at least k — S follows from 
Proposition 3.4, since g{k, ^ n ^) C Ag{k, .^). D 

4. Multiply Symplectic Grassmannians 

Let X be a scheme, and S a vector bundle on X of rank r. Suppose we are given 
a collection 

U = {(,)i,...,U™} 

of symplectic forms on S . Then we make the following definition: 

Definition 4.1. Given k < r, we have the multiply symplectic Grassman- 

nian MSG{k,S', {,)) defined as the closed subscheme of G{k,S) determined by 
subbundles which are simultaneously isotropic for every (, )i G (, ). 

Clearly, a subspace gives a point in MSG{k, S", (, )) if and only if it is isotropic 
for an arbitrary linear combination of the (, )i. 

A phenomenon which is not an issue in the classical case of a single form is that 
the geometry of a multiply symplectic Grassmannian can depend radically on the 
relationship between the forms. In the classical case that X is a point, if the forms 
are sufficiently general, the multiply symplectic Grassmannian has codimension 
771(2) ^^ ^{^^ <^)- However, the case of interest for us is not completely general, so 
we have to give a closer analysis. In the case m = 2, we find that the key condition 
for good behavior is that as we vary over all linear combinations of the (, )i, the 
rank of the pairing on the subspace in question should not drop by more than 1. 
More precisely, our main result is the following: 

Theorem 4.2. In the case m — 2, suppose that X is regular. Given a field 
K extending F , and a K-valued point x of X , a simultaneously isotropic sub- 
space V C S'\r^ corresponds to a point of the doubly symplectic Grassmannian 
MSG{k,S', {,)) which is smooth of codimension 2(2) inside G{k,S') if and only 
if for every nonzero K -linear combination (, ) of the (, )i\x, there does not exist any 
2- dimensional subspace V' QV for which the induced pairing 

(,):]/' X ^U/1/ ^ F 

vanishes identically. 

Because the proof of the theorem is rather technical, we first draw the desired 
consequence for our applications. 

Corollary 4.3. Suppose S is a vector bundle of rank r on a regular algebraic stack 
X , and (, )i for i ~ 1,2 are symplectic forms on S . Let ^ and ^ be subbundles of 
§ of ranks s and t, both isotropic with respect to both of the (, )i. Let Q{k, ^ n 5^) 
denote the closed substack of Q{k, S") parametrizing subbundles of S contained in 
both J^ and 'S . Suppose that for field K extending F , and some K-valued point 
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X of X , the subspace '^\x C §\x has the property that for all 2-dimensional sub- 
spaces V' C ^|a;, the two pairings V x S'\x -^ F induced by the (,)i are linearly 
independent. Then for any k-dimensional subspace V C ^jj. n '^\x ^ S'\x) every 
component of G{k, ^ fl ^) passing through the point corresponding to V ^ (S\x has 
codimension at most 

k{2r - s - t) - 2(^^ 

ing{k,S). 

Proof. First consider the case that X = X \s a, (regular) scheme. We consider 
G{k,J^) as a closed subscheme of G{k,S'), of codimension k{r — s). We note 
that G{k,,^) has a natural map to MSG{k,S, (,)) Xx MSG{t,S, (,}), with the 
map to MSG{t, £",{,)) induced by ^ and the structure map to X. Moreover, 
G(fc, ^n^) is the prcimage of the incidence correspondence / under this map. We 
claim that MSG{k, S, {,)) Xx MSG{t, S", (, }) is smooth at the image of the point 
corresponding to T^ C (S'\x, and that / has pure codimension k{r — t) — 2Q) at this 
point. Smoothness in MSG{t,S', (,)) follows directly from Theorem 4.2 and our 
hypotheses. On the other hand, because V C ^j^,, any 2-dimensional subspace of V 
is also contained in ^j^:, so Theorem 4.2 also implies smoothness of MSG{k, (o, (, )). 
The codimension statement for / is obtained by arguing as in Corollary 3.7. We thus 
conclude the desired statement from Lemma 3.5. Again arguing as in Corollary 3.7, 
we deduce the stack case from the scheme case by passing to a smooth cover. D 

The remainder of this section is devoted to proving Theorem 4.2, and will not 
be used elsewhere. The following lemma is used to reduce Theorem 4.2 to the case 
that X is a point. 

Lemma 4.4. Suppose that X is a regular scheme, f : Y -^ X is smooth, and 
Z = Zi n Z2 is the intersection of closed subschemes Zi C Y . Given z G Z, 
suppose that the Zi are Cohen- Macaulay at z, of pure codimension di in Y , for 
i = 1,2. If the image of z in X is x, we then have that z is a smooth point of 
Z , with codimy Z = di + d2 at z, if and only if z is a smooth point of Zx, with 
codimy-^ Zx = di + d2 at z. 

Proof. Clearly if Z is smooth over X of the appropriate codimension, then the 
same is true for the fiber Zx- Conversely, by Theorem 17.5.1 of [3] if Zx is smooth 
of codimension di + d2 at z, it is enough to show that Z is flat over X at z. 
Because Y is smooth over a regular scheme, we have codimy Z < di + (i2 at z, 
but because everything is catenary, the bound on dimension in terms of fibers gives 
codimy Z > codimy^ Zx = di + ^2 at z, so we conclude that Z has the expected 
codimension in Y at z, and it follows (see for instance Lemma 4.5 of [5]) that Z 
is Cohen-Macaulay at z, and then from the standard flatness criterion (Corollary 
6.1.5 of [2]) that Z is fiat over X at z. D 

The idea of the proof of Theorem 4.2 is to calculate the tangent space as an 
intersection of the tangent spaces of the appropriate symplcctic Grassmannians. 
The first step is the following, which is a simple calculation, and left to the reader: 

Lemma 4.5. Let E be a vector space over a field K of dimension r, and (, ) a 
symplcctic form on E. Given k < ^, and a subspace V C E of dimension k 
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which is isotropic for (, ), under the standard identification of Tv{G{k, E)) with 
Hom(y, i?/y), we have that the tangent space Tv{SG{k, E, (,))) is identified with 

{^ e IIom{V,E/V) : ^vi,V2 G V, (wi,(^(w2)) - {v2,f{vi)) = 0}. 

Note that in the above, the terms (vi,ip(v2)) and {ip(vi),V2) are well-defined 
because V is assumed to be isotropic. Indeed, if V is isotropic, then (, ) induces a 
homomorphism ijj : E/V — > V*, and the lemma may be rephrased as saying that 
(fi S Hom(y, E/V) is in the tangent space to SG{k, E, (, )) if and only ii ip o ip is 
self-dual. Because (,} is nondegenerate, as (p ranges through Hom(y, £'/!/), the 
composition i{j o ip ranges over all of Hom(y, y*). Choosing a suitable basis, one 
then sees that the condition that ^poipis symmetric imposes (2) linear conditions on 
Hom(y, _E/y), agreeing with our previous codimension calculation for symplectic 
Grassmannians. 

The main point is thus to prove: 

Proposition 4.6. Given vector spaces V, W of dimensions k < n, and surjective 
linear maps ipi,ip2 ■ W ^ V* , the two systems of (2) linear conditions imposed on 
ip G Hom(y, W) by the condition that ^loip be symmetric are dependent if and only 
if there is a 2-dimensional subspace V' <^V and scalars Ai, A2 not both zero, such 
that for all v €V' and w G W, we have Xi{ipi(w)){v) + X2{''p2iw)){v) = 0. 

One direction of the proposition is easy, and holds for any number of linear maps 
(equivalently, any number of linear forms). Before giving the relevant statement, 
we give an explicit description of what it means to have a linear dependence among 
the 771(2) conditions in question. 

Lemma 4.7. Given ^1, . . . , V'm ■ W —^ V* , and vi, . . . ,Vk a basis of V , the rn(^) 
conditions requiring that each ipi°^ be symmetric are linearly dependent if and only 
if there exist Ci,j^e not all 0, for i = 1, . . . , to and 1 < j < i < k, such that for all 
ip G Hom(V, W) we have 

J2'^ijA{M^M))M - iM'pM)){vj)) = 0. 

Proof For each i the condition that ipi o ip he symmetric is equivalent to requiring 
that for each v,v' G V, we have {tpi{p{v))){v') = {ipi{ip(v'))){v). It is sufficient to 
impose this condition for v = Vj,v' = vi, with j < £, giving us the (2) conditions 
for each i. The desired assertion follows immediately. D 

We then have: 

Lemma 4.8. Given vector spaces V, W of dimensions k < n, and surjective linear 
maps ^i,...,V'm '. W ~^ V* , if there exists a 2-dimensional subspace V' C V 
and scalars Ai,...,Am not all zero, such that for all v ^ V' and w G W, we 
have "^i K{'4'i{'w)){v) = then the m systems of (2) linear conditions imposed on 
p G Hom(y, W) by the condition that ipi o ip be symmetric are dependent. 

Proof. Indeed, let tii,i'2 be a basis for V . The dependence of conditions for each 
Ipi is explicitly constructed by the observation that for all ip, we have 

J2 ^^^(^2))^ - Uip{vi)){v2)) - 0. 
i 

Since vi, V2 are linearly independent, they can be extended to a basis of V , and we 
obtained the desired linear dependence by Lemma 4.7. D 
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We now begin the core technical work for proving Proposition 4.6. The foUowing 
definition is convenient for our analysis. 

Definition 4.9. Given k < n, wc say a, k x n matrix A is in generalized Jordan 

normal form if the leftmost k x k block is in Jordan normal form. 

We will always work with only a single matrix in generalized Jordan normal 
form, so we can impose the following notation without fcar of confusion: 

Notation 4.10. If A is in generalized Jordan normal form, let A^ denote the diagonal 
entries of A, and set e^ = {A)i^i^i for z = 1, . . . , fc — 1. We also use the convention 
that eo = efc = 0. 

The first key technical lemma is the following. 

Lemma 4.11. Given k < n, let A be a kxn matrix, and suppose there exist scalars 
Ci,j, c'; ■ for all I < i < j < k, not all zero, and such that for every nxk matrix B, 
we have the identity 

(4.1) E ^'j(^^^^ - ^^■^) = E <A^AB\^ - iAB),,{). 

i<3 i<3 

Suppose further that A is in generalized Jordan normal form, and c^ 7^ for some 
i < j occurring in the generalized Jordan blocks in the zqi ■ • ■ : *i ci^d jo, ... , j'l rows 
of A, with zq < ii,jo l£ ji- Then we have: 

(i) ii < jo; 

(ii) Xi ~ Xj for any i,j with io < i < ii and Jq < j < j'l; 

(iii) the matrix {c'i j)i„<i<i-^,jo<j<j-^ takes constant values along antidiagonals, 
with non-zero entries only occurring for i + j > max{io + ji,ii + Jo}- 

Proof. We use the convention that Ci^i = c^ ^ ^ for i = 1, . . . , fc. Given any i,j 
with i + 1 < j, wc first observe that if i?i+i.j = 1, Sj,i+i = b, and Bf,^' = for all 
other £,i', then (4.1) simplifies to 

Ci+ij(l -b)= c';+ij(A,+i - bXj) + c,^_^e, - c^+ij_i&ej_i. 

Since this holds for all b, we find 

(4-2) Ci+ij = 4+i^^A,+i + c^j-e, = c'^+i.j>^j + c[^i,j-i^j-i- 

Also obersve that if i + 1 = j, setting Bi+i,i+i = 1 and all other entries equal to 
similarly gives 

(4.3) = c^+ie,. 

We will prove by induction on j — i that if the ith and jth rows are in the 
same Jordan block of A, then c^ , = 0. Being in the same block is equivalent to 
ei ^ e^+i — ■ ■ ■ — ej_i = 1, and then Xi = A^+i = • • • = Xj, so (4.2) reduces to 

(4.4) Ci+i,j — Cj_|_jjAi + Cjj ~ c^_^_J^ jXi + Ci+ij^i. 

The base cases are j = i + I and j = i + 2. In the first case, (4.3) together with 
Ci = immediately yields c^ ^_^_i — 0, as desired. In the case j = i + 2, (4.4) 
yields c^ ^^2 = c^+i i+i = by our earlier convention. Now we consider the case of 
arbitrary i < j — 1. Then (4.4) yields c[ = c^j^_i j_i, so by the induction hypothesis, 
we have c'^j = 0, as desired. We thus conclude (i). 

To prove (ii), suppose we are given io < ii < jo < ji such that there exist i,j 
with c'^j ^ 0, io < i < ii,jo < j < ji, and further suppose we have chosen i,j 
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SO that i + j is minimal with respect to these conditions. Thus we have either 
Ci_ij = 0, or i = io, so that et^i = 0, and similarly either c'^j^i = or e^-i = 0. 
Replacing i + 1 with i in (4.2), we find c[.j{\i - \j) = c'^^j^i^j-i - c[_^,jei^i = 0, 
so we conclude that A; = \j. 

Finally, (iii) is equivalent to the assertions that when c[ ■ ^ 0, if e^ = 1 then 
j > jo and c-_|_^ j_j = c- j, and if ej ~ 1 then i > io and c^_ij^i = c-^. First 
suppose Ei = 1. Then i < ii < j, so from (4.2) we obtain 

We also have A^+i = Ai = Xj by (ii), so the right hand side is 0. Since c^ e; = c'^ ■ is 
assumed non-zero, we conclude that ej_i ^ and hence j > jo and c^_^i ■_]^ = c'^ -, 
as desired. The case that Cj = 1 is obtained in the same way, if we replace i + 1 by 
i and j — 1 by j in (4.2). D 

We can now prove the next lemma, which yields Proposition 4.6 almost imme- 
diately. 

Lemma 4.12. In the situation of Lemma 4^.11, with c[ ^ for some i < j, so 
that Xi — Xj , we have 

dimker(^ - A,;/fc,„)'^ > 2. 

Proof. Continuing with the convention that c^ ^ = 0, we also extend c^ for j < i 
by setting c^ ■ = ~c' i. Suppose we choose i minimal in a given Jordan block of 
A such that c'j j ^ for some j, and set Vi = {c[ i, . . . ,c^ f.). Then we claim that 
Vi{A — Xilk,n) = 0. To see this, we first observe that for any j with c^ ^ 0, the 
minimality of i within its Jordan block gives c'j^_i j^i-i = 0. For j > i, replacing 
i + 1 with i in (4.2) we have 

(4.5) Cij = cljX, + c-_ijei_i = c- j-Ai. 

Under our convention for j < i, one checks that we still obtain (4.5) from (4.2). In 
order to verify our claim, we return to (4.1), and for any j = 1, . . . , n, set Bj^i — 1, 
and all other coefficients of B to be 0. In this case, (4.1) yields 

e>i £<i 

k 

1=1 
using the convention that Qj =: if j > k. The righthand side is equal to the 
dot product —vi ■ (Ai^, . . . , A^j), while our (4.5) gives us that the lefthand side is 
—Xic[j = —Vi ■ (0, . . . , 0, Ai, 0, . . . , 0). Since the identity holds for all j — 1, . . . , n, 

we conclude that Vi{A — Xilk,n) — 0, as desired. 

It remains to prove that given any i < (,' with c'^, 7^ 0, there are at least two 
choices of i as above such that the corresponding Vi are linearly independent. But 
this is clear: we have from Lemma 4.11 that the ^th and £'th rows are contained in 
different Jordan blocks with the same eigenvalue, so we can take i minimal as above 
for each of the two Jordan blocks gives the desired pairs of linearly independent 

V^. D 

We can now quickly conclude our main results. 
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Proof of Proposition Jf..6. One direction is proved by Lemma 4.8. For the converse, 
we suppose that we have a Hnear dependence among the 2(„) conditions imposed 
by the condition that both -0^ o (^ be symmetric for all ip £ Hom(V,VF). It is 
clear that we can choose bases of V and W so that (in terms of the induced dual 
basis on V*^ we have that 'i\)\ is the matrix consisting of the k x k identity matrix 
followed by the k x {n — k) zero matrix. Moreover, since we have assumed that F 
is algebraically closed, by modifying the bases compatibly, we can further put the 
matrix A corresponding to "02 into generalized Jordan normal form. Translating 
Lemma 4.7 into this context, we find that the existence of a linear dependence is 
precisely equivalent to the existence of Cij^c'^ as in (4.1). According to Lemma 
4.12, we can then produce the desired space V' as any 2-dimensional subspace of 
kcr(j4 — KIk,n)'^ , yielding the desired result. D 

Proof of Theorem Jf..2. Because the individual symplectic Grassmannians SG{k, S , (, )i) 
for i = 1, 2 are smooth, we can apply Lemma 4.4 to reduce the theorem to the case 
that X is a point. In this case, again using smoothness of the symplectic Grass- 
mannians, we have that MSG{k, <?, (, )) is smooth of codimension 2(2) at a point 
if and only if the tangent spaces of the two symplectic Grassmannians intersect 
transversely at that point. Lemma 4.5 describes these tangent spaces, and apply- 
ing Proposition 4.6 to the case that W = r^lx/V and the ipi are induced by the (, )i 
then yields the desired statement. D 

5. Expected dimensions in fixed determinant 

We can now prove Theorems 1.1 and 1.3. The lemma introducing the required 
symplectic forms is essentially due to Bertram-Feinbcrg and Mukai, stated slightly 
more generally as follows: 

Lemma 5.1. Given Jff of degree d on C , and an effective divisor A of degree S 
on C, suppose that (^ : .if — > w(A) is a non-zero morphism. Let X be a stack 
over Spec F, and S a vector bundle of rank 2 on C x X, with an isomorphism 
(lets' -^ Pi-Sf- Then for any effective divisor D on G, if we set D' = p^D on 
G X X, we have that S := p2sr{S'[D')/ ^{—D' — A)) is a vector bundle of rank 
4deg£' -|- 25 on X , and we obtain an alternating form (, ) on S defined by 

(si, S2) = ^ resp ip{si^p A h.p), 
Pec 
where each Si_p is a representative in S{D') of Si in a suitable neighborhood of P, 
and we extend ip to a map from rational sections of S£ to rational sections of lo. 

If further both D' and A have support disjoint from the vanishing locus of (f, 
then (,) is a symplectic form, and p2*{(S'/S'{~D' ~ A)) is a subbundle of S of rank 
2 degD -|- 26, with uniform degeneracy of rank 2 deg D. If also for every geometric 
point X £ X, we have that the corresponding fiber S\x of S satisfies 

h\G,SUD)) = h°{G, S\A-D - A)) = 0, 

then p2* {'S'{D')) is a subbundle of S of rank d + 2 deg D + 2 — 2g, and is isotropic 
for (,). Moreover, under the given hypotheses the construction of all bundles in 
question is compatible with base change. 

Of course, the importance of the lemma is that we can recover P2*{S) as the 
intersection oi p2*{S / S {- D' - A)) with p2*{S{D')) inside S. 
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Proof. First, the asserted compatibility with base change immediately reduces the 
lemma to the case of a base scheme. Since <S'{D')/S'{—D' — A) has fibers which 
are skyscraper sheaves of length 4deg-D + 26, by cohomology and base change we 
have that pushforward commutes with base change, and S" is locally free of rank 
4degi:' + 26. Similarly, it's clear that p2*{S/S'{-D' - A)) is a subbundle of <? of 
rank 2 deg D + 26. 

Next, note that <p(si p A S2_p) is a section of uj{2D + A) in a neighborhood of 
P, and thus the residue can only be non-zero if P is in the support of D or of A. 
If either Si^p is in (S{—D' — A), then we have <f{si^p A S2,p) a local section of w, so 
the residue vanishes. We thus obtain a well-defined alternating form on co. 

If D and A are disjoint from the vanishing locus of if, a local calculation shows 
that (, ) is nondegenerate, hence symplectic. Similarly, in this case the degeneracy 
subbundle of p2* {S/S{-D' - A)) is precisely pa* ((f (- A)/^(-D' - A)), so has rank 
2degil', as asserted. 

Now, if h^{C, (S'\j;{D)) = for all x, then by cohomology and base change push- 
forward commutes with base change, and p2*{S'{D')) is locally free, with its rank 
d + 2 dcg D + 2 — 2g given by the Riemann-Roch formula. The hypothesis that 
h^{C, S'\x{—D — A)) = for all x insures that p2*{S'{D')) injects into S', and con- 
tinues to inject after arbitrary base change, which in particular implies that it is a 
subbundle. Finally, it is isotropic for (, ) by the residue theorem, since in this case 
we have every Si^p coming from a single pair of global sections, so we are simply 
summing the residues of a single rational differential form. D 

Proof of Theorem 1.1. Because h^ {C , .^ {- 1^)) > 0, we have /iO(C, ^"^ ®a;(A)) > 
0, and we can thus fix a non-zero morphism Lp : I£ ^^ '^(^)- Since 6 is assumed 
minimal, we moreover have that the support of A is disjoint from the vanishing 

locus of Lp. 

Let U be any open substack of 7V{(2, Jf) of finite type, and Su the universal 
bundle on C xU. Then a sufficiently general choice of sufficiently ample divisor D 
on C will be disjoint from the vanishing locus of tp, and because we assumed U is 
of finite type, for every vector bundle S'\x corresponding to a point x Cz U we will 
haveifi(C,(fU(£')) = H°{C,<^\x{-D - A)) = 0. Fixing such a £», let D' = pl{D) 
on C xU. Now, according to Lemma 5.1 wc have that P2*{<^u{D') / S'u{~ D' — A)) 
is locally free of rank 4dcgD + 26, with subbundles P2*(S'u/S'u{—D' — A)) and 
P2*S'u{D'), of rank 2dcg£' -f- 26 and d + 2 dcg I? + 2 — 2g respectively. Moreover, 
P2*{S'u{D')/S'ij{—D' — A)) carries a symplectic form (, ), with P2*S'u{D') isotropic 
for (, ); and P2*{S'u/<S'u{—D' — A)) having uniform degeneracy of rank 2degD. 

Let Q be the relative Grassmannian G{k,p2*{S'u{D')/S'u{—D' — A))), which is 
smooth of relative dimension fc(4deg£' + 26 — k) over U. Let ^ be the univer- 
sal subbundle on Q, and set Qu{2,^,k) to be the open substack of G{2,j!f,k) 
parametrizing pairs for which the underlying bundle is contained in U. Then ob- 
serve that Gu{'2, -Sf , k) can be identified with the closed substack of G on which ^ 
is contained in both P2*{<S'u/(S'u{—D' — A)) and p2*(S'u{D'). Applying Corollary 3.7, 
we find that every component of Gui'2, -Sf , k) has codimcnsion in G bounded above 

by 

/k — 6 
k{AdegD + 26-d-2 + 2g)- i 
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By Corollary A. 9, we thus find that every component of Gu{2, ^, k) has dimension 
at least 

3g - 3 - /c(/c - rf + 2.g - 2) + r 2 '^ j = p - .9 + r' 2 "^ 

As U varies over all bounded open substacks of A1(2,^), it covers the entire 
moduli space, so we conclude that the obtained dimension bounds apply to all of 
Q{2, ^, fc), as desired. The final assertion is an immediate consequence of the last 
statement of Corollary 3.7, since the degeneracy subbundle of p2* ('=«/'=« (—-D' — A)) 
is precisely p2*{Su{-^)/Su{-D' - A)). D 

We now move on to proving Theorem 1.3. The lemma which allows us to ap- 
ply Corollary 4.3 is the following, which holds more generally than the case that 
/ii(C,Jf) = 2. 

Lemma 5.2. Given J^ of degree d on C, suppose that h^(C,J^) ~ ra> 0. Choose 
m linearly independent morphisms ipi : ^ -^ lo. LetlA he a finite-type open substack 
of Ai{2, ^), and Su the universal bundle on CxlA. Then for any sufficiently general 
choice of a sufficiently ample divisor D on C, if D' = p\D , the alternating forms 
{,)i on S := p2t{'S'{D')/S'(^D')) induced by the ipi and summing over residues as 
in Lemma 5.1 have the following property: for every point x d U, and Ai, . . . , A„i 
not all 0, the alternating form '^^Xi{,)i induces an infective map p2*{S'\x{D)) -^ 

Note that in particular, the lemma implies that for D sufficiently general and 
sufficiently ample, the (, )i are linearly independent. 

Proof. Since D is assumed to be sufficiently ample, a sufficiently general choice of 
D will be a reduced divisor Pi + • • • + Pdeg d for distinct points Pi £ C. Let /i = 
1, /2, . . . , fm be the rational functions on C such that (pi = fiipi. Any sufficiently 
general D will have support disjoint from the vanishing of each ipi , and consequently 
from the zeroes and poles of the fi. Now, (S{D')/S{—D') has support only at the 
Pi, of length 4 at each point. Suppose we have s G H^{C,S\x{D)/S'\x{—D)) and 
constants A^ for i = 1, . . . , m such that for all s' G H^{CtS\x{D)/S'\x{~D)), we 
have 

(5.1) ^A,(s,s')»-0. 

i 

Equivalcntly, (5.1) is satisfied for any s' supported only at a single Pj. A local 
calculation at Pj shows if s is non-zero at Pj (that is, if a local representative for s 
is not in S\x{—D)), a necessary condition for (5.1) to hold for all s' supported only 
at Pj is the identity 

(5.2) ^AJ,(P,) = 0. 

i 

Now, because lA is quasicompact, the instability of the corresponding vector 
bundles is bounded, and it follows that if s is actually a section in H^{C, S\x{D)), 
then the number of Pj at which s can vanish (in the sense that s G (?'|x(— Pj) in 
a neighborhood of Pj) grows more slowly than degD as AcgD increases, and in 
particular for D sufficiently ample, we have that any such s must be non-zero at at 
least m of the Pj . Then for D sufficiently general, the linear independence of the fi 
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implies that (5.2) cannot hold at all m of the Pj where s is non-zero. We conclude 
the desired injectivity. D 

Proof of Theorem 1.3. Because h^{C,^) > 2, wc have ft."(C,^"i (g) w) > 2, and 
we can thus fix a pair of linearly independent morphisms v?i, </92 '. ^ -^ ui. 

As before, let U be any open substack of A1(2,.if) of finite type, and Sy the 
universal bundle on C xl4. Then a sufficiently general choice of sufficiently ample 
divisor D on C will be disjoint from the vanishing loci of ipi and ip2, and for ev- 
ery vector bundle S'lx corresponding to a point oiU, will satisfy H^{C,S'\x{D)) = 
H°{C,S\x{-D)) = 0. Fixing such a D, let D' = pl{D) on C x M{2,^). Let g be 

the relative Grassmannian^(fc,p2*(<^w(£'')/'^w(-£'')))- Since p2*(<^w(-D')/'%(--D')) 
is locally free of rank 4 deg D, we have Q smooth of relative dimension fc(4 deg D — k) 
over U. Let ^ be the universal subbundle on Q. As before, the open substack 
Qui'2,^,k) C Q{2,^,k) parametrizing pairs for which the underlying bundle cor- 
responds to a morphism into U is realized as the closed substack of Q for which ^ 
is contained in both P2*{S' / S" {— D')) and p2*S'{D'), which have rank 2dcgD and 
d + 2 deg D + 2 — 2g respectively. 

Also as before, symplectic forms play a crucial role, but now we have from Lemma 
5.f that p2*{S'{D')/S{—D')) carries two symplectic forms (, ).; induced by Lpi for 
i = 1, 2. We thus have that p2*S{D') and p2*{iff /S{—D')) are both simultaneously 
isotropic for both forms. Moreover, by Lemma 5.2, we have that (by choosing a 
more ample and more general D as necessary) the space (, ) of forms spanned by 
the (, )i is 2-dimensional and consists entirely of forms with no degeneracy on any 
fiber oip2*Su[D'). Thus, we can apply Corollary 4.3 to find that every component 
of Qu{2,^, k) has codimension in Q bounded above by 

k{^AegD-d-2 + 2g)-2{^^ 

By Corollary A. 9, we thus find that every component of Gu{2, ^, k) has dimension 
at least 

3g-3-/c(/c-d + 2g-2) + 2Q =p-g + 2Q 

As U varies over all bounded open substacks of A1(2,^), it covers the entire 
moduli space, so we conclude that the obtained dimension bounds apply to all of 
^(2, ^,fc), as desired. D 

6. Further discussion 

It is well known (see for instance Comments 4.6 of [4]) that in higher rank, 
there are cases where the expected dimension is positive but the Brill-Noether loci 
are empty. The same is true for loci with fixed determinant and the appropriate 
modified expected dimension. In particular, a component of the Brill-Noether locus 
may be large enough to dominate the Jacobian, but may fail to do so. This makes 
it difficult to predict when a modified expected dimension in fixed determinant 
will in fact give rise to an entire component of the Brill-Noether locus of varying 
determinant. Wc conclude by examining this issue in detail in two specific examples. 

Example 6.1. We consider the case k = 2, and d = g ~ 2, with C assumed to 
be general. The expected dimension of Qc{2,g — 2,2) is p{2,g — 2,2, g) — I = 
2g — 8 (the reduction by I in dimension arised because we are considering the stack 
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rather than the coarse moduh space), so for g > 7, we have that Qc{2,g — 2,2) 
has dimension large enough to surject onto Pic^^ (C); in particular, for any line 
bundle ^ of degree g — 2, even the naive expected dimension of Q{2,^, 2) is non- 
negative. Moreover, we have h^{C, ^) > 0, so iiQc{2, g—2, 2) does in fact dominate 
Pic^~^(C), it follows from Theorem 1.1 that it must have strictly larger than the 
expected dimension. 

However, at least on the stable locus Qfj{2,g ~ 2, 2), this is not the case. Indeed, 
Teixidor [9] analyzes the case r = fc = 2 more generally, and shows that on a 
general curve, Q^{2,d,2) is irreducible of the expected dimension. She shows that 
the general linear series in this space is of the form {S',H'^{C,S')), where c? is 
obtained as an extension 

and we then necessarily have /i°(C, ^) = /i"(C, det (?) > 0. In our case of degree 
g — 2, such ^ have codimension 2 in Pic^~^(C). It follows that Gci2, 3 — 2, 2) docs 
not dominate Pic^~^(C), and moreover that for a general ^ G Pic^^^(C) with 
/i°(C,^) > 0, we have dim g** (2, .if, 2) > ,0^(2, g). This is thus consistent with 
Theorem 1.3. 

However, we see that our techniques, and in particular the last statement of 
Theorem 1.1, can shed some light on such emptiness examples. Although the 
following corollary is rather trivial (and is in any case an immediate consequence 
of Teixidor's analysis), it may be of interest that the argument is quite atypical. 

Corollary 6.2. Suppose charF = 0. Set d = g — I — £, with C general and £ > 0, 
and fix J£ a line bundle of degree d with h^{C,J^) = 0. Then there does not exist 
any semistable vector bundle S of determinant ^ with h^(C, S) >2. 

Proof. We begin with the case k = 2, d = g — 1, where h'^{C,^) = is equivalent 
to h^{C,^) = 0. But since h^{C,^{-P)) > for any P g C, we have 6 = 1, and 
wc can choose A = P for any P. It follows from the final statement of Theorem 
1.1 that for any pair ((o", V) with determinant ^, and for any P £ C, at least one 
section of V vanishes at P. In particular, the sections of V do not generate S" at 
any point, and it follows that V is contained in some line subbundle ^ of S', which 
must then have degree at least ^-^, and therefore destabilizes (o. 

For the general case, h"{C, if ) = is equivalent to h"{C, uj®^-^) = h^{C, ^) = 
£. Because we are in characteristic 0, for a general P £ C the vanishing sequence 
for hP{C, ui ® J^~^) is generic, so for £' < £ wc have that 

h\C, ^{£'P)) = /i"(C, iu ® ^-i(-£'P)) =£-£', 

and we conclude that h^{C, ^{£'P)) = 0. Thus, if we have S' of determinant ^ with 
/i°(C, ^) > fc, and we set £' = 2[|J , then for general P we stiU have h°{C, <S{^P)) > 
k and /iO(C,if(f P)) = 0. We claim that S'{^P), and hence (f, is unstable. If £ is 
even, this is immediate from the d = g —1 case above. If £ is odd, then (f(-|-P) has 
degree g — 2. Let S" be an inverse elementary transformation at a general point Q, 
so that detff' = ^{£'P + Q) has degree 5 -1, and h"{C,^{£'P + Q)) = as before. 
By the above, S" has a line subbundle of degree at least ^^ , so we conclude that 
£'{^P) has a line subbundle of degree at least |, and is therefore still unstable, as 
desired. D 
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We conclude by remarking that while we believe our main results show sub- 
stantial promise for generalization, possibly as far as a comprehensive collection of 
expected dimensions in rank 2, any generalization will not be routine. One indi- 
cation is that our results on expected dimensions thus far have not required any 
stability hypotheses. However, if, as expected, one obtains higher and higher ex- 
pected dimensions as h^ (C, J^) grows, then these modified estimates will almost 
certainly not apply to arbitrarily unstable bundles. Indeed, for sufficiently unsta- 
ble bundles, the determinant is completely unrelated to the number of sections, so 
we should expect any fully general answer to combine determinant conditions with 
stability conditions. 

Appendix A. Codimension in stacks 

We give a basic treatment of codimension for algebraic stacks. We follow the 
terminology and conventions of [7]. We assume throughout that A" is a locally 
Noctherian algebraic stack. 

Definition A.l. Let A" be a locally Noetherian algebraic stack, and Z C X a, 
closed substack. The codimension of Z in X is defined to be the codimension in 
X of X Xx Z, where A ^ <Y is a smooth cover of X. 

Proposition A. 2. Codimension is well defined, and finite. 

Proof. Wc first verify that codimension is well defined. If X, X' are both smooth 
covers of X^ then X Xx X' is a, smooth cover of both X and A', so it is enough 
to see that codimension is preserved under passage to a smooth cover. But this is 
true more generally for flat covers, see Corollary 6.1.4 of [2]. 

We next verify finiteness. By definition, any smooth presentation P : A — > A" has 
A locally Noetherian. Now, codim^t' Z := codim^ P~^Z, and in order to establish 
finiteness of codimx P~^ Z , it is enough to show that codim^ Z' is finite for some 
irreducible component Z' of P~^Z . But let Z' be any irreducible component; since 
A is locally Noctherian, there exists an open subschemc U C X which meets Z' 
and is Noetherian. Then codinix .^' — codiniu Z' , and codimu Z' is finite, as 
desired. D 

Lemma A. 3. Let Z Q X be an irreducible component. If X ^ X is a smooth 
morphism from a scheme X, then every irreducible component of Z := Z Xx X is 
an irreducible component of X . 

Proof. Let ( the generic point of an irreducible component oi Z := Z Xx X, and 
S, be the generic point of Z (for the existence and uniqueness of generic points of 
algebraic stacks, see Corollary 5.7.2 of [7]). Because Z is flat over Z, it follows 
from Proposition 5.6 and Corollary 5.7.1 of [7] that the image of C is £,■ But by the 
same argument, any generization of C in X must map to ^ as well, in which case 
it is contained in Z by deflnition. We conclude that C is a generic point of A, as 
desired. D 

We immediately conclude: 

Corollary A. 4. Let Z 'Z X be an irreducible component. Then Z has codimension 
m X. 

We now specialize to the case of stacks of finite type over a field. 
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Proposition A. 5. Suppose X is an irreducible algebraic stack, of finite type over 
a field. Then for any smooth cover P : X -^ X and any irreducible component Z 
of X , we have 

dim X = dim Z — dim^ P, 
where dim^ -P denotes the relative dimension of P along Z. 

Note that because the relative dimension of a smooth morphism is locally con- 
stant, dim^ P is well defined. 

Proof. Let 77 be the generic point of X . Recall that every irreducible component of 
X dominates X , and in particular if Z' is any irreducible component meeting Z , 
and ^, ^' are the generic points Z, Z' respectively, then using that X is locally of 
finite type over a field, the definitions give us 

dim Z—dimz P = dim^ Z—dim^ P =: dim,; X := dim^' Z'— dim^/ P = dim Z' —dimz' P. 

But again using that dimP is locally constant, since Z' intersects Z we conclude 
that dim Z ~ dim Z'. 

Now suppose that x G P{Z), and choose a point z ^ Z mapping to x. We then 
have 

dim,, X := dim^ X — dim^ P = dim Z — dim^ P = dim^ X — dim^ P =: dim^. X, 

where the identity dim Z = dim^ X follows from the fact that any irreducible 
component of X meeting Z has the same dimension as Z . 

We thus have that dim,, X = dim Z — dimz P, and further that dim,, X ~ dmix X 
for any x G P{Z). However, since Z was an arbitrary component of X, we conclude 
that dim,, X = dim^. X for every x € X, and thus we obtain the desired statement 
on dimX. D 

Proposition A. 6. Suppose X is an irreducible algebraic stack, of finite type over 
a field, and Z <Z X is an irreducible closed substack. Then for any smooth cover 
P : X -^ X and any irreducible components X' of X and Z of P^^Z with Z C X' , 
we have 

codim;^ Z — codinix' Z = dim A' — dimZ. 

Proof. By definition, we have codim;v' 2 = codimxP~^-Z, so the first identity 
amounts to showing that codimx' Z is independent of the choices of X' and Z, 
which in turn is a consequence of the second identity. Since X' and Z are irreducible 
and X is locally of finite type over a field, we have codimx' Z = dimX' — dmiZ. 
But according to Proposition A. 5, we have 

dim X' — dim Z = dim X + dimjf ' P — dim Z — dim^ P = dim X — dim Z, 

where dimj^:/ P = dimz P because Z C X' . We thus conclude the desired statement. 

D 

Corollary A. 7. Suppose X is an algebraic stack of finite type over a field, and 
Z C X is a closed substack. Then 

codim^t' -Z — min max codim;^' -2' 

Z'CZ \X"ZX:Z"ZX' 

where Z' and X' range over irreducible components of Z and X respectively. 
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Proof. Both sides can be defined in terms of a sniootli cover. Ttie oniy obstruction 
to the desired identity is that a priori on the righthand side we have a minimum over 
a maximum over a minimum over a maximum, and we need to fcnow that this may 
be rewritten as a singic minimum over a maximum. But according to Proposition 
A. 6, the codimension vaiue is independent of the choices of components under the 
smooth cover, so wc obtain the desired statement. D 

Corollary A. 8. Suppose that B is an equidimensional scheme of finite type over 
a field, and X is an algebraic stack smooth of relative dimension n over B. Then 
every irreducible component of X has dimension dim_B + n. 

Proof. Let P : X ^ X he a smooth presentation, and x <E X. Choose any x E X 
lying over x, and let m be the relative dimension of P at x. Then we have by 
definition dinia; X = dimj X — m, and since X is smooth over i? at i of relative 
dimension m + n, we have dim^ X = dim B + m + n, so we conclude that dinia. X = 
dim_B + n. Since x was arbitrary, we have that every component of X has the 
desired dimension. D 

Putting together Proposition A. 6, Corollary A. 7, and Corollary A. 8, we finally 
conclude: 

Corollary A. 9. Suppose that B is an equidimensional scheme of finite type over 
a field, X is an algebraic stack smooth of relative dimension n over B, and Z (- X 
is an irreducible closed substack, of codimension c. Then 

dim Z ~ dim B + n ^ c. 
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